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Abstract — The capacity of the multiple-access channel with 
any distribution of messages among the transmitting nodes 
was determined by Han in 1979 and the expression of the 
capacity region contains a number of rate bounds and that grows 
exponentially with the number of messages. We derive a more 
compact expression for the capacity region of this channel in 
which the number of rate bounds depends on the distribution 
of the messages at the encoders. Using this expression we prove 
capacity for a class of general cognitive network that we denote 
as "very strong interference" regime. In this regime there is no 
rate loss in having all the receivers decode all the messages and 
the capacity region reduces to the capacity of the compound 
multiple-access channel. This result generalizes the "very strong 
interference" capacity results for the interference channel, the 
cognitive interference channel, the interference channel with a 
cognitive relay and many others. 

Index Terms — multiple access channel, cognitive network, 
strong interference, superposition coding, cut-set bound. 

I. Introduction 

The multiple access channel is a well studied channel 
model where multiple transmitters communicate with a sin- 
gle receiver. The capacity region of the two-users multiple- 
access channel was characterize in 1971 by Ahlswede [IJ 
and Liao [2J. Slepian and Wolf |3| studied a more general 
two-users channel where the transmitters, in addition to their 
own message, also cooperate in communicating a common 
message. Han [4J generalized all the previously known results 
and derived the capacity region of a general multiple-access 
channel with any distribution of the messages at the encoders. 
The expression of the capacity region contains an auxiliary 
random variables for each of the messages to be transmitted 
and a number of rate bounds that grows exponentially with 
the number of messages. Despite of this result, it is known 
that, in certain special cases, it is possible to describe the 
capacity region with less rate bounds and fewer random 
variables. Two such examples are the multiple-access channel 
with independent messages [fl, O and the degraded multiple- 
access channel |5|. Giindiiz and Simeone |6| derived a com- 
pact expression for the capacity region of a multiple-access 
channel with a specific distribution of the messages among the 
transmitters that encompasses the examples above. The authors 
also describe an algorithmic procedure to convert a general 
multiple access channel in an multiple-access channel with 
the specific message distribution they consider, but provide no 



closed form expression for the general case. 

One can sometimes exploit the available capacity results for 
the general multiple-access channel to derive the capacity for 
a subclass of general channels in what is generally referred 
to as the "very strong interference" regime. This regime is 
characterized by the fact that the level of the interference 
at each decoder is so high to allow for the decoding of all 
the interfering signals and the complete cancelation of the 
interference As a result, the capacity region of the channel 
reduces to the intersection of the multiple-access channels 
between the transmitters and each receiver. The first "very 
strong interference" result was derived for the two user in- 
terference channel Carleial |7| and Sato fSl. Inspired by this 
result, similar "very strong interference" capacity results was 
proved for the two user cognitive interference channel ||9]|, the 
interference channel with a cognitive relay fTOl and others. 
An interesting "very strong interference" result is provided by 
Sridharan et al. for the Gaussian symmetric K-user interference 
channel [llj by employing lattice codes: here the receivers 
do not decode each interfering signal separately, but instead 
decode their total sum. We note that this result heavily relies 
on the structure Gaussian channel and does not extend to a 
general channel model. 
Contributions and Paper Organization : 
Sec. int-We introduce a general cognitive network and the 
notation used throughout the paper. 

Sec. [mi- We provide inner and outer bounds for the general 
cognitive network. The outer bounds is reminiscent of the cut- 
set outer bound and the inner bound is based on rate splitting 
and superposition coding 

Sec. [TVl-We provide a compact characterization of the 
capacity for a general multiple-access channel which 
requires less rate bounds than [4J and is valid for a general 
distribution of messages, unlike |6|. 

Sec. rvl-We show capacity for a general cognitive network 
in "very strong interference" regime in which capacity is 
achieved employing superposition coding and having all the 
decoders decode all the messages. 

Sec. rvH-We provide an example of our results by deriving 
capacity in the "very strong interference" regime for the in- 
terference channel where each transmitter is sending a private 
and a common message. 



II. Network Model 

We consider the general cognitive multiple-terminal network 
in IIT2II where A^tx transmitting nodes want to communicate 
with A^Rx receiving nodes. A given node may only be a 
transmitting or a receiving node, that is, the network is single- 
hop and without feedback or cooperation. The transmitting 
node k, k e [1 : A^tx], inputs Xj. to the channel, while the 
receiving node z, z e [1 : A^rx], has access to the channel 
output Yz. The channel transition probability is indicated 
with Pvi-.YN^^lXi-.XNrj.^ the channel is assumed to be 
memoryless. The subset of transmitting nodes i, i C ^Nt^, 
is interested in sending the message Wi^j to the subset of 
receiving nodes j C ^at^x ^^^^ ^ channel uses. The message 
VFi^j, (i, j) C ^attx ^ ^A^RX' uniformly distributed Random 
Variable (RV) in the interval [0 : 2^^^^-^ - 1], where N is the 
block-length and Ri^j the transmission rate. 

A rate vector R = {Ri^j, V (i,j) C ^at^x x ^^Vrx} is 
said to be achievable if there exists a sequence of encoding 
functions 



= X^, {{Wi^i, s.t. Ri^i GK,kGi})., 
and a sequence of decoding functions 

such that 



(1) 



lim maxP W^^-. ^ W( 



0. 



The capacity region C(R) is the convex closure of the region 
of all achievable rates in the vector R-pairs. 

The general network model we consider is a variation to 
the network model in [13, Ch. 14] but we allow for messages 
ho be distributed to more than one user while disregarding 
feedback. Fig. \T\ depicts a general cognitive network. 
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A. Notation 

When considering the capacity problem C(Ri^j) we use 
the following notation 

• S is a set containing (i, j) pairs: 



Sc{(i,j) s.t. i?i^jGR}, 



(2) 



and S indicates the complement of the set. 

Ts is the set of transmitters that can conveys all the 

messages in S: 



T^s = {k,ke f] i|>, 

(i,j)eS 



(3) 



• Rs is the set of all the receivers that decode any of the 
messages in S 



Rxs 



z,z e 



U J 

(i,j)eS 



(4) 



III. 



Inner and Outer Bounds for a General 
Cognitive Network 



Fig. 1. The general cognitive network. 
In the following we focus in particular to the general 
Multiple-Access Channel (MAC), that is, the channel where 
there is only one receiver (A^rx = 1). 



We begin by stating outer bounds for the general cognitive 
network model in Sec. [Ill that was originally devised in |4, Th. 
5.1]. This outer bound generalizes the outer bound in |6, Th 
3.2] to any number of users and is reminiscent of the cut-set 
bound in [13, Th. 14.10.1] when extended to the case where 
messages are distributed among the users. 

Corollary III.l. Cut-Set Bound for a General Cognitive 
Network If the rate vector R is achievable for the general 
multi-terminal network in Sec. |^ the following must hold 

o< ^i-j^ E nyz;{Xk,^k} (5) 

(i,j)eS zSRxs 

fceTxs.},{c/i^j, (i,j)er}), 

for every S as defined in ([2]) and any partition {S^} ofS with 

(i,j)GS- ^ zel (6) 

and any distribution 

P{Xk, V v(i,j)} = n ^f^-J n^-^^l{^-J' ^i}- 

(ij) k 

(J) 

Proof: See f4l for a complete proof. In essence Fano's 

inequality is applied to any set of messages Wi^j, (i,j) G S 

Set j of as 
receiving 

nodes ^ iJi^j < ^ J(rf eS^}) (8a) 

(i,j)es zeRxs 

< /(n;{m^eS^}|{W/i^jer}), (8b) 

^GRxs 

where determines which VFi^j are decoded at receiver z 
(note that the complement of S is taken with respect to all 
the messages in the network). The single letterization follows 



from the memoryless property of the channel and the bound 
in Q is obtained defining the auxiliary RV Ui^j = Wi^j. ■ 
We now derive a general achievable region obtained with 
the chain graph representation of an achievable scheme in |[T2li 

Corollary III.2. An Achievable Region Based on Super- 
position Coding and Rate Splitting A rate vector R is 
achievable in the general network in Sec. |3 if there exists 
a rate vector Raii such that 

jail = U J ^^^^ ^ {^i^jain 1 ^ ^} 
jGR 

j 

that satisfies 

J2 ^i^an < I (n; {Xk, V k} I {UUi^^^, (i, jail eW)}), 

(i,jaii)eS' 

(10) 

for all the subsets C {(i, jaii), (ijaii) ^ Rail} such that 

(ijaii) eS' =^ (ijaii) eS', VlCi, (11) 
for all decoders z and for any distribution 

P{Xk, V (iJalOGRall} = 

(ijall) k 

Proof: The theorem is a special case of the general 
achievable region in fT2l . All the messages Wi^j are decoded 
at all receivers. The messages transmitted by the same set of 
encoders i are encoded in the codeword U^^^ with rate Ri^j^^^, 
where subscript |aii indicates that the codeword is decoded by 
all receivers. Equation (O describe the rate splitting strategy 
where all the messages are decoded at all the receiver. For this 
reason, the messages known at the same set of encoders i can 
be encoded in the same codeword U^^^^^^ with rate Ri^j^^^. 
The two codewords U^^^^^^ are then superposed the one on 
top of the other if the bottom codeword is known at a larger 
set of encoders than the top codeword. Intuitively, each rate 
bounds corresponds with the event that the all the codewords 
U^^^^ii in in ([TOl) has been incorrectly decoded while the 

codewords in S are correctly decoded. Not all the possible 
decoding errors are possible, though. When a codeword U.^^^^u 
has been incorrectly decoded, all the codewords superposed 
to U^^^^ii are incorrectly decoded as well. This condition is 
expressed by equation ([TT1) . ■ 

IV. A New Formulation of Capacity for a General 
Multiple-Access Channel 

We begin by stating the formulation of the capacity region 
of a general MAC derived in |4, Th. 5.1] 

Corollary IV. 1. The Capacity Region of a General 
Multiple-Access Channel [4, Th. 5.1] The capacity of the 



general MAC is 

R,^, < I (r,; {X^, V k} I {[/i^,, (i, z) e S}) , 

ii,z)e s 

(13) 

for all the sets S in ^ and taken the union over all the 
distributions in (|7]). 

Theorem IV.2. Compact Formulation of the Capacity 
Region of the Multiple Access Channel The capacity of the 
general MAC is given by ([T3l) for all the sets S such that (fTTl) 
for S = S' holds and taken the union over all the distributions 
in m for Ui^, = UU^^^^. 

Proof: We show capacity by matching each of the rate 
bounds in the inner bound expression in ([TOb with a outer 
bound expression in ([5]) and then consider the union over all 
the possible distributions Pui^^ in the two regions. Since there 
is only decoder in the network, z, only one permutation {S^} 
is possible and it is = S. Again, given that there is only 
one decoder, we have that jaii = z and thus we can match 
each S in Cor. HIOl with the set = S in Cor. HITT] and 
Ui^z = ^i-^j^n' ^^^^ shows that for each rate bound in Cor. 
nil. 21 there exists a matching outer bound in Cor. IIII.ll The 
proof concludes by noting that the distribution of the auxiliary 
RVs Ui^j in the inner bound, ([T2l) has a more general form 
that the distribution in the outer bound, (|7]). ■ 
The result in Th. IIV.2I is a extension of |6, Th 3.2] to the 
general MAC channel. Note that the number of bounds in 
the formulation of the capacity region in Cor. (llV.lb grows 
exponentially with the number of messages since the possible 
sets S are obtained from all the permutations in On the 
other hand the expression of the capacity region in Th. IIV.2I 
grow, in general, much less since one needs to consider only 
the permutations of S for which (fTTl) holds. 

Remark IV. 3. It interesting to compare the region in Cor. IIV.II 
with the region in Th. IIV.2I in the of region Cor. IIV.II the 
number of bounds increases exponentially with the number 
of messages but the auxiliary RVs Ui^z are independent. For 
the region in Th. IIV.2I is more compact but the auxiliary RVs 
Ui^z are no longer independent. It appears that one can trade 
a simpler expression in the capacity region at the cost of using 
correlated RVs in the expression of this region. 

V. Capacity for a General Cognitive Network 

In this section we utilize the expression of capacity of the 
general MAC channel in Th. IV. 3 1 to derive the capacity of 
the general network in the "very strong interference" regime, 
where there is no loss of optimality in having all the receivers 
decodes all messages. In this class of channels the inner 
expression in Cor. IV.2I and outer bound expression of Cor. 
IIII.ll can both be simplified and shown to be equivalent. 

We begin by deriving the conditions under which the outer 
bound expression can be simplified by replacing the bounds 
in Q. The outer bound obtained in this case is sometimes 
referred to as "strong interference" outer bound. 



Corollary V.l. Strong Interference Outer Bound 

Consider a set S in Cor. MIL 1\ and a partition {S^}, if 



E 

2;GRxs 



(iJ)eS 



ii) there exists a partition {S^} and some z' for which 
condition (O holds, qr^ 

iii) there exists a set {Saii, Yz} for which condition ([Tt]) holds. 

Proof: The complete proof can found in fTT] .The expres- 
sions in (fTSl) and ([T9l) relate the auxiliary RV in the inner 
bound to the auxiliary RVs in the outer bound. As also pointed 
out in Cor. IIII.2[ the inner bound is produced by having all the 
decoders decode all the messages: this means that the mes- 
sages transmitted by the same set of encoders i but destined 
to different sets of decoders j can be embedded in a single 
codeword, ^i^j^^^- The set S' describe all the possible error 
events when decoding ^i^j^^^^ since this codeword encodes a 
_^ multiple messages for different set of decodersj, an error in 

I(Xz'] {Xk, V k} (i, j) G S }). (16) decoding U^- corresponds to an error in decoding all the 



< / (n^; {X,, V k} |{/7i^j, (i, j) G S}) , (14) 

for all the distributions of {X^, V k} and {Ui^j^ (i,j) G M} 
in d?]) and for some z' , then the hound in ^ for S, {S^} and 
z can he eliminated from the outer hound while the following 
hound is introduced 



(15) 



Proof: The complete proof can found in |14|. ■ 
Note that the bound in ( fT6t needs not be a bound of the 
outer bound region in Cor. IIII.ll 

Corollary V.2. Simplified Inner Bound Consider a set S' in 
Cor. ITZO if 



I 



{S',n} 

janes')}), (17) 

for some set {S'} D S' such that ([171) hold for every S' and 
for all the distributions 6>/ |/7/^j, (i, j) G r| m (O and for 

some set of output {Y^}, then the bound in (fTOl) for S' and z 
can be eliminated from the achievable region. 

Proof: The complete proof can found in fT45 : the theorem 
states the conditions under which a rate bound in the inner 
bound in Th. IV. 21 can be eliminated because it is larger than 
a linear combination^of other rate bounds in the achievable 
region. The each s^ S' corresponds to a rate bound in ([TOb for 
a channel output Y^. The collection of sets {S^} corresponds 
then to the summation of different bounds that is larger than 
rate bound in ([TtI) for S' and Yz. ■ 
By combining the results in Cor. IV. II and Cor. IV. 21 we can 
finally prove capacity for a general cognitive network in the 
"very strong interference" regime. 

Theorem V.3. Very Strong Interference Capacity Results 

Consider the achievable region in Cor \III.2\ with the assign- 
ment 

f^Un = {^-j. (18) 

SO that the set S' in Cor \III.2\ coincides with the set S for 

S = {(i,j), ieS', jGR}, (19) 

and the rate vector R is obtained from the rate vector Raii 
with (O. This region is capacity if for each S in ([T9l) and 
each z, one of the following conditions holds 
i) 2: G j)GsJ ^^^^ {^^} — 



messages it encodes. This is formally expressed by ([T9l) : S is 
obtained from S' by considering all the messages Wi^j that are 
encoded in ^i^j^^^ for a given (i, jaii) G S^ Having specified 
the relationship between auxiliary RVs in the inner and outer 
bound specified by (fTSl) and ([T9l) , we can now proceed in 
matching inner and outer bound. This can be done in three 
ways: either i) there exists an outer bound expression matching 
the inner bound , or ii) we set the conditions to impose a 
matching outer bound expression iii) we set the condition for 
the inner bound expression to be redundant. ■ 

Remark V.4. From Th. IV. 3 1 one concludes that capacity can 
be determined by imposing different conditions on Yz and 
Ui^fs. Not all the choices will be feasible though and some 
choices will be unfeasible for all channels but some degenerate 
channel. 

VI. An Example: the Interference Channel with 
Common Messages 

We now apply the results of Th. IV. 3 1 to a sample channel: 
the InterFerence Channel with two common messages (IFC- 
2CM). The IFC-2CM is a classical interference channel where 
each transmitter is also sending a common message to the two 
decoders. A graphical representation of this channel ran be 
found in Fig. [21 




Rx 1 



Rx2 



^ ^{1,2} 



< ^Wl,2} 



Fig. 2. The InterFerence Channel with 2 Common Messages (IFC-2CM) 

We start by considering applying Cor. IIII.2I to this channel 
model. The private message Wi^i and I^i^{i,2} are both 



encoded by transmitter one and are thus encoded in the 
same codeword U^_^^-^ 2}'Si^^^ Jaii = {l^^}, for R[^^i 2} = 
Ri^i +i?i^{i,2}- Tlie same reasoning can be appHed to the 
messages of the second user. The achievable region with the 
rate-spHtting in Q is 

^i^{l,2} + ^2^{1,2} - H^u^l^^2), 

for Pxi.u' and with i G {1,2}. With the assignment in 
(fTSl) and (ftol we obtain the achievable region 

+ i?,^|i,2} < /(ri;Xi,X2|/7i^i,/7,^|i,2}) (20a) 

i^2^2 + i^2^{l,2} < /(l2;Xi,X2|/72^2, t/i^{l,2}) (20b) 
Rl^l + ^1-{1,2} + R2^2 + ^2^{1,2} < /(yi;Xi,X2) 

(20c) 

Rl^l + ^1^{1,2} + ^2^2 + ^2^{1,2} ^ ^(^2; -^1,-^2), 

(20d) 

We now match the inner bound expression in ([20b with 
the outer bound in Cor. IIII.ll By consider S = = 
{(1, 1), (1, {1, 2})} in Cor. IIILTI we obtain the bound 

Rl^l + i^i^{l,2} < ^(^1; Ui^i, /7i^|i^2}|^2^2, ^2^{1,2}), 

which is equivalent to the bound in (I20at . The bound for (I20bt 
is obtained from 8 = 8^ = {(2, 2), (1, {2, 2})} in a similar 
manner. The bound in (I20cl) cannot be matched with an outer 
bound from Cor. IIII.ll since the decoders are not required to 
decode all the messages. From Cor. IIII.ll we can obtain sum 
rates bounds of the form 

^sum < /(yi;Xi,X2|[/i^{l,2}, ^^2^2, ^1^{1,2}) 

+ /(r2;Xi,X2|/7i^i) (21a) 

i^sum < /(l^i;Xi,X2|/7i^|l,2},/72^2) 

+ 7(^2; Xi, X2|/7i^i, , /72^{i,2}) (21b) 

i^sum < /(yi;Xi,X2|[/2^|l,2},t/2^2) 

+ 7(^2; Xi, X2|/7i^i, , /7i^|i,2}) (21c) 

Rsnm<I{Yi-Xi,X2\U2^2) 

+ 7(^2; Xi, X2|/7i^i, , /7i^|i,2}, ^2^{1,2}), (21d) 

and for i^sum = ^i^i +^i^{i,2} +^2^2 + ^2^{i,2} To show 
that the region in (l2Ql) , we can impose conditions as in Cor. 
IV. 2 1 and Cor. IV. II This can be done in different ways: 
•Remove two sum rates from the inner bound by imposing 

(l2Qal) + (l2Qbl) < max{(|20c|, (l2Qdl) }. 

in which case the capacity region reduces to (l2Qal) and (l2Qbl) . 
•Remove a sum rate from the inner bound and add a 
sum rate in the outer bound by setting (l2Qdl) > (l2Qcl) and 
one of the following conditions (l2Qcl) > (l21aK (l2Qcl) > (l21bK 
(l2Qcl) > (12 let or (I20cl) > (I21dl) . in which case the capacity 
region reduces to (l2Qal) , (l2Qbl) and (l2Qcl) . One can also consider 
the symmetric conditions obtained by setting (l2Qcl) > (l2Qdl) 
and change the other conditions accordingly. 
•Add two sum rates in the outer bounds by setting, 
for example, either (12 lab > max{ (l2Qcl) . (l2Qdl) } or (12 lab > 



(l2Qcl) . (l2Tbl) > (l2Qdt or (|2Tc]) > (|20c]), (l2Tdl) > (l2Qdt and so 
on. 

VII. Conclusion 

In this paper we derive the a compact representation of the 
capacity of a general multiple-access channel with any number 
of transmitters and any distribution of messages among the 
transmitters. From this result we derive a capacity result in a 
certain class of a general class of channels with any number 
of transmitters, receivers, and any distribution of messages. 
In this class of channels, that we denote as in "very strong 
interference", there is no rate loss in having every decoder 
decode all the messages and the capacity region reduces to 
the intersection of the multiple-access channels from all the 
encoders to each decoder. To exemplify this result we derive 
capacity in the "very strong interference" regime for the 
interference channel where each decoder is sending a message 
to the intended receiver and also a message to both receivers. 
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